Raiders of the Lost Architecture: Kernels for Bayesian Optimization in Conditional Parameter Spaces

نویسندگان

  • Kevin Swersky
  • David Duvenaud
  • Jasper Snoek
  • Michael A. Osborne
چکیده

In practical Bayesian optimization, we must often search over structures with differing numbers of parameters. For instance, we may wish to search over neural network architectures with an unknown number of layers. To relate performance data gathered for different architectures, we define a new kernel for conditional parameter spaces that explicitly includes information about which parameters are relevant in a given structure. We show that this kernel improves model quality and Bayesian optimization results over several simpler baseline kernels.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Lost Space Renewal; a Reborn of an Urban Water Body

Due to rapid growth of urbanization and economic demand, we are continuously losing our fields,our free lands, open sky, ponds, lakes; actually our breathing spaces. Sometimes for zoning policies, migration ortransferal of a particular business or activity, a place like waterfronts, body of water, military or industrial sites can lostits importance, kept vacant and become a dead place. These ar...

متن کامل

An Introduction to Inference and Learning in Bayesian Networks

Bayesian networks (BNs) are modern tools for modeling phenomena in dynamic and static systems and are used in different subjects such as disease diagnosis, weather forecasting, decision making and clustering. A BN is a graphical-probabilistic model which represents causal relations among random variables and consists of a directed acyclic graph and a set of conditional probabilities. Structure...

متن کامل

Defining a Structural Model for the Revitalization of the Lost Urban Spaces (City Entrances) in Contemporary Urban Design Case Study: Entrance of Sanandaj

Not long ago, city gates and entryways had high spatial value and were among the landmarks for marking city boundaries. Today with cities having been expanded and developed, such aspect of the entrance concept is lost and entryways are turned to passages for transportation. In fact, the rich spatial value of such entrances has decreased as they are solely spaces for passing through out or into ...

متن کامل

Application of Architectural Visual Documents and Oral History of in the Representation of Micro-Spaces and Three-Dimensional (3D) Modeling of Nawab Razavi Historical House in Yazd

Over the time, various factors have led to damage the Iranian houses. By examining the surviving documents of Nawab Razavichr('39')s house in Yazd, it is possible to represent a major part of the lost spaces and also to minimize speculation in the restoration of this historic house. The basic belief of this research is that the studies of the oral history of architecture as well as the existing...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013